Goto

Collaborating Authors

 video domain generalization


Supplementary Material for " Diversifying Spatial-Temporal Perception for Video Domain Generalization " Kun-Y u Lin

Neural Information Processing Systems

Hard Norm Alignment loss (HNA): apply the HNA loss (Eq. HMDB, which demonstrates the effectiveness of our model. First, we drop feature from a specific spatial group. Method UCF HMDB STDN-T -1 59.2 STDN-T -2 58.1 STDN-T -3 59.4 STDN-T -4 58.9 Full STDN 60.2 Second, we drop feature from a space scale. In our main manuscript, we conduct all experiments based on ResNet-50.


Diversifying Spatial-Temporal Perception for Video Domain Generalization

Neural Information Processing Systems

Video domain generalization aims to learn generalizable video classification models for unseen target domains by training in a source domain.A critical challenge of video domain generalization is to defend against the heavy reliance on domain-specific cues extracted from the source domain when recognizing target videos. To this end, we propose to perceive diverse spatial-temporal cues in videos, aiming to discover potential domain-invariant cues in addition to domain-specific cues. We contribute a novel model named Spatial-Temporal Diversification Network (STDN), which improves the diversity from both space and time dimensions of video data. First, our STDN proposes to discover various types of spatial cues within individual frames by spatial grouping. Then, our STDN proposes to explicitly model spatial-temporal dependencies between video contents at multiple space-time scales by spatial-temporal relation modeling. Extensive experiments on three benchmarks of different types demonstrate the effectiveness and versatility of our approach.


Diversifying Spatial-Temporal Perception for Video Domain Generalization

Neural Information Processing Systems

Video domain generalization aims to learn generalizable video classification models for unseen target domains by training in a source domain.A critical challenge of video domain generalization is to defend against the heavy reliance on domain-specific cues extracted from the source domain when recognizing target videos. To this end, we propose to perceive diverse spatial-temporal cues in videos, aiming to discover potential domain-invariant cues in addition to domain-specific cues. We contribute a novel model named Spatial-Temporal Diversification Network (STDN), which improves the diversity from both space and time dimensions of video data. First, our STDN proposes to discover various types of spatial cues within individual frames by spatial grouping. Then, our STDN proposes to explicitly model spatial-temporal dependencies between video contents at multiple space-time scales by spatial-temporal relation modeling.